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DETAILED ACTION 



1. 



This office action is in response to communication filed on 3/15/2010. 



2. 



Per Applicant's request, claims 70, and 100 have been amended. 



3. 



As per claims 70 and 72-121 are pending. 



Claim Rejections - 35 USC §112 



The following is a quotation of the second paragraph of 35 U.S.C. 112: 

The specification shall conclude with one or more claims particularly pointing out and distinctly 
claiming the subject matter which the applicant regards as his invention. 

4. Claims 72-78 rejected under 35 U.S.C. 112, second paragraph, as being indefinite for 

failing to particularly point out and distinctly claim the subject matter which applicant regards as 

the invention. 

Claims 72-78 recites the limitation "claim 71" in "The apparatus according to claim 71". 
There is insufficient antecedent basis for this limitation in the claim. 



The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 

obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

5. Claims 70, 72, 84-86, 90-91, 98-104 are rejected under 35 U.S.C. 103(a) as being 

unpatentable over Silver et al. (herein Silver, 5,481,712) in view of Comaniciu et al. (herein 

Comaniciu, "Image-guided decision support system for pathology", Spring-Verlag 2000", 



Claim Rejections - 35 USC §103 



previously recited.) 
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Per claim 70, 
Silver discloses 

a collector computer including a vision tool selector configured to select, via a manual 
entry interface, at the collector computer, at least one chosen vision tool and, from 
among plural selectable vision tools, corresponding vision tool parameters 
corresponding to the chosen vision tool (c4: 2-18, "...The system 205 includes a selection 
elements 200, an input parameter element 204... allows the system operator to select a specific 
machine vision tool... The selected machine vision tool preferably requires one or more input 
parameters..."); 

(i) image data including at least one given image to be analyzed by the chosen tool (c4: 
19-21, "The imaging element 250 generates a candidate image of an object upon which a 
machine vision analysis tool is to operate."); and (ii) the corresponding vision tool 
parameters (c4: 2-18, "...The system 205 includes a selection elements 200, an input 
parameter element 204... allows the system operator to select a specific machine vision 
tool... The selected machine vision tool preferably requires one or more input parameters..."); 

wherein the machine vision engine includes selectable vision tools including the chosen 
vision tool, the selectable vision tools having been configured to, when selected, carry 
out vision operations including pattern location on the given image (see above). 



Silver does not specifically disclose 
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a transmitter configured to send, from the collector computer to a machine vision engine located 
remotely from the collector computer and via a communications network, (i) the image data and 
(ii) the corresponding vision tool parameters; and 

wherein the machine vision engine is remote from the computer (as explained above) 
However, Comaniciu discloses 

a transmitter configured to send, from the collector computer to a machine vision engine 
located remotely from the collector computer and via a communications network (section 
3, 1st para., "...The client part is intended to be used in small hospitals. ..through the Internet..." 
See Fig 1 for client server configuration, where the client is the computer and the bottom of Fig. 
1 is the remote machine vision engine, the Internet is a network.), (i) the image data (Fig. 1, top 
box, I/O where query image gets one given image, Bottom middle box, "Feature Matching" 
analyses the image. Fig. 1 shows at least one vision tool.), and (ii) the corresponding vision 
tool parameters (Fig 1 ., I/O module of Fig. 1 also get parameters, for example, page 214, left, 
col.; 3 rd para., "...selecting a rectangular region of interest (ROI).." where ROI is considered 
parameters; or last para, "...four visual attributes of the delineated cell nucleus are delineated: 
shape, texture, area, and color." These example attributes are considered parameters) ; and 
wherein the machine vision engine is remote from the computer (as explained above) 

Therefore, it would have been obvious to a person of ordinary skill in the art at the time the 
invention was made to incorporate the teachings of Comaniciu into the teachings of Silver by 
modifying the apparatus of Silver to have the machine vision engine remote from the collector 
computer. The modification would be obvious to one of ordinary skill in the art to want to have a 
client-server architecture so one machine vision engine can serve multiple collector computers. 
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As per claim 72, the rejection of claim 71 is incorporated; Silver discloses 

wherein the machine vision engine includes machine vision software encoded on 
computer-readable media and executed by a computer(d: 17-18, "...a collection of 
"tools"..."). 

As per claim 84, the rejection of claim 70 is incorporated; Comaniciu discloses 

wherein the computer includes the transmitter (section 3, 1st para., "...The client part is 
intended to be used in small hospitals. ..through the Internet..." See Fig 1 for client server 
configuration, where the client is the computer and the bottom of Fig. 1 is the remote machine 
vision engine, the Internet is a network.) 

As per claim 85, the rejection of claim 70 is incorporated; Comaniciu discloses 

wherein the communications network includes an internetwork (section 3, 1st para., 
"...through the Internet..." See Fig 1 for client server configuration, where the client is the 
computer and the bottom of Fig. 1 is the remote machine vision engine, the Internet is a 
network.) 

As per claim 86, the rejection of claim 85 is incorporated; Comaniciu discloses 
wherein the internetwork includes the lnternet(section 3, 1st para., "...through the Internet..." 
See Fig 1 for client server configuration, where the client is the computer and the bottom of Fig. 
1 is the remote machine vision engine, the Internet is a network.) 
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As per claim 90, the rejection of claim 70 is incorporated; Comaniciu discloses 

wherein the transmitter is configured to send, via the communications network, an 
indication of the selected one or more given vision tools (continue from rejection of claim 
70, page 8, claim 31, "...said selected vision tool... results of all applied vision tools..."; [0018], 
"...He then set virtual vision tools..." where shows selections of visions tools.). 

As per claim 91, the rejection of claim 70 is incorporated; Comaniciu discloses 

wherein the machine vision engine includes machine vision software encoded on 
computer-readable media and executed by a computer ((section 3, "System Architecture", 
"...a client-server... implemented in Java..." which include software in Java stored in computer- 
readable media and executable by a computer.). 

As per claim 98, the rejection of claim 70 is incorporated; Comaniciu discloses 

a client data procurer configured to send an image acquisition command to an image 
acquirer to acquire image data including the given image data(see Fig. 1 and related 
description). 

As per claim 99, the rejection of claim 70 is incorporated; Comaniciu/ Freifeld discloses a 
receiver configured to receive results data originating from the machine vision engine, 
the results data including a result of the machine vision engine having analyzed, with the 
selected one or more given vision tools, the given image sent by the transmitter in 
accordance with the corresponding vision tool parameters sent by the transmitter (see 
rejection of claim 70.). 
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As per claim 100, the rejection of claim 99 is incorporated; Comaniciu discloses wherein the 
computer includes the receiver(Fig. 1, "client presenter" receives images and presents 
them.). 

As per claim 101, the rejection of claim 70 is incorporated; Comaniciu discloses further 
comprising an image acquirer configured to capture and store an image of a part (page 
214, 3 rd para., "...loading the query image...") 

As per claim 102, the rejection of claim 101 is incorporated; Comaniciu discloses wherein the 
image acquirer includes a frame grabber(page 214, 3 rd para., "...loading the query 
image... selecting a rectangular region..." ). 



As per claim 103, the rejection of claim 101 is incorporated; Comaniciu / Freifeld discloses 
wherein the image acquirer is positioned on a production line (Freifeld - [0005], 
".. .manufacturing process. . ."). 

As per claim 104, the rejection of claim 101 is incorporated; Comaniciu discloses further 
comprising the machine vision engine (see Fig. 1) 



6. Claims 73-76, 92-95, are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Silver et al. (herein Silver, 5,481 ,712) in view of Comaniciu et al. (herein Comaniciu, "Image- 
guided decision support system for pathology", Spring-Verlag 2000", previously recited.) 
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further in view of Geodeon et al. (herein Geodeon, "Applying Machine Vision In Electrical 
Component Manufacturing"). 



As per claim 73-76, the rejection of claim 71 is incorporated; 
Silver/Comaniciu does not specifically disclose 

wherein the vision operations include guidance, inspection, gauging, and identification. 
However, 

Gedeon discloses 

wherein the vision operations include guidance (page 748, left col. Middle, "vision guided 
robotic application...";), inspection, gauging, and identification (page 738, right col.) 
Therefore, it would have been obvious to a person of ordinary skill in the art at the time the 
invention was made to incorporate the teachings of Gedeon into the teachings of Comaniciu/ 
Freifeld to include the limitation disclosed by Gedeon. The modification would be obvious to 
one of ordinary skill in the art to want to examine the geometry of a product as suggested by 
Gedeon (page, 738, 4 th para, "...examine the geometry of the product..") 



As per claims 92-95, the rejection of claim 70 is incorporated; see reasons for rejections of 
claims 73-76. 
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7. Claims 77, 78, 96, 97, are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Silver et al. (herein Silver, 5,481 ,712) in view of Comaniciu et al. (herein 
Comaniciu, "Image-guided decision support system for pathology", Spring-Verlag 2000", 
previously recited.), and further in view of Edwards et al. (herein Edwards, "Machine 
vision and its integration with CIM systems in the electronics manufacturing industry"). 



As per claim 77, the rejection of claim 71 is incorporated; 
Silver/ Comaniciu discloses 

The vision operations include a selectable vision tool and carry out a correspond 
operation corresponding to the obtained operation vision tool parameters(see rejection of 
claim 70). 

However, Silver/ Comaniciu does not specifically disclose 

The selectable vision tool is guidance vision tool configured to, when selected, (i) the 
parameters including a model pattern and alignment operation constraints, and (ii) carry out a 
corresponding guidance operation corresponding to the obtained guidance operation vision tool 
parameters. 



However, Edwards discloses 
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The selectable vision tool is guidance vision tool configured to, when selected, (i) the 
parameters including a model pattern and alignment operation constraints, and (ii) carry 
out a corresponding guidance operation corresponding to the obtained guidance 
operation vision tool parameters(page 14, item 'Position Feedback is used for alignment of 
the work piece... as to their exact position..."; page 18, middle, "..process product models", it is 
inherent that in order to perform alignment, the product model information as well alignment 
operation constraints are available, otherwise the alignment has no base to carry out the vision 
operation.) 

Therefore, it would have been obvious to a person of ordinary skill in the art at the time the 
invention was made to incorporate the teachings of Edwards into the teachings of Silver/ 
Comaniciu to include the limitation disclosed by Edwards. The modification would be obvious to 
one of ordinary skill in the art to want to improve both flexibility and reliability in manufacturing 
systems through alignment operation as suggested by Edwards ( see page 12, 1 st para.). 



As per claim 78, the rejection of claim 77 is incorporated; 
Edwards discloses 

wherein the alignment operation constraints include parameters defining a minimum 
match quality and allowable scale and rotation change (page 16, right col, top, "..edge 
match..." to perform edge match, minimum match quality and allowable scale and rotation 
change needs to be defined.). 

As per claims 96-97, the rejection of claim 70 is incorporated; see reasons for rejections of 
claims 77-78. 
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8. Claims 79-83 are rejected under 35 U.S.C. 103(a) as being unpatentable over Silver et 
al. (herein Silver, 5,481,712), Comaniciu et al. (herein Comaniciu, "Image-guided decision 
support system for pathology", Spring-Verlag 2000", previously recited.) in view of Freifeld 
(USPGN 2002/01 91 836) and further in view of McCall et al. (hereinafter, McCall, USPGN 
2004/0005396). 

As claims 79-81, 

Silver/Comaniciu/ Freifeld does not specifically disclose 

wherein the vision tool parameters input includes a keyboard, a mousse or a touch pad of the 
computer. 

However, McCall discloses 

wherein the vision tool parameters input includes a keyboard, a mousse or a touch pad 
of the computer ([0099], "...input means... keyboard, mouse... touch pad. ..enter or 
view.. .parameters...") 

Therefore, it would have been obvious to a person of ordinary skill in the art at the time the 
invention was made to incorporate the teachings of McCall into the teachings of 
Silver/Comaniciu/ Freifeld to include the limitation disclosed by McCall. The modification would 
be obvious to one of ordinary skill in the art to want to use widely available input devices such 
as keyboard, mouse or touch pad to input parameters. 
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As per claim 82, the rejection of claim 70 is incorporated; 
Silver/Comaniciu/ Freifeld does not specifically disclose 

wherein the vision tool parameters input is configured to receive the corresponding vision tool 
parameters via manual entry at the computer. 

However, McCall discloses 

wherein the vision tool parameters input is configured to receive the corresponding 
vision tool parameters via manual entry at the computer([0099], "...input means... keyboard, 
mouse... touch pad. ..enter or view.. .parameters..." where the above input methods are manual.) 

Therefore, it would have been obvious to a person of ordinary skill in the art at the time the 
invention was made to incorporate the teachings of McCall into the teachings of Silver 
/Comaniciu/ Freifeld to include the limitation disclosed by McCall. The modification would be 
obvious to one of ordinary skill in the art to want to allow users to manually enter parameters. 

As per claim 83, the rejection of claim 82 is incorporated; 
Silver/Comaniciu/ Freifeld does not specifically disclose 

wherein the manual entry is via a manual entry interacting with an application program run on 

the computer. 

However, McCall discloses 

wherein the manual entry is via a manual entry interacting with an application program 

run on the computer([0099], "...input means... keyboard, mouse... touch pad. ..enter or 
view.. .parameters..." where there is an application program running on the computer to receive 
input) 
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Therefore, it would have been obvious to a person of ordinary skill in the art at the time the 
invention was made to incorporate the teachings of McCall into the teachings of Silver 
/Comaniciu/ Freifeld to include the limitation disclosed by McCall. The modification would be 
obvious to one 

9. Claims 87-89 are rejected under 35 U.S.C. 103(a) as being unpatentable over Silver et 
al. (herein Silver, 5,481,712), Comaniciu et al. (herein Comaniciu, "Image-guided decision 
support system for pathology", Spring-Verlag 2000", previously recited.) in view of Freifeld 
(USPGN 2002/0191836) and further in view of Taylor, III etal. (herein Taylor, USPTN 
6,813,621). 

As per claims 87, 88 and 89, the rejection of claim 70 is incorporated; 
Sliver / Comaniciu / Freifeld does not specifically disclose 
An image file and the image file includes a JPEG file or a bmp file. 
However, Taylor discloses 

An image file and the image file includes a JPEG file or a bmp file(c3: 36-42, 
"...manipulate... JPEG... BMP..."). 

Therefore, it would have been obvious to a person of ordinary skill in the art at the time the 
invention was made to incorporate the teachings of Taylor into the teachings of Sliver / 
Comaniciu / Freifeld to include the limitation disclosed by Taylor. The modification would be 
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obvious to one of ordinary skill in the art to want to be able to process commonly used JPEG 
and BMP format files. 



10. Claims 105, and 118-121 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Comaniciu et al. (herein Comaniciu, "Image-guided decision support system for pathology", 
Spring-Verlag 2000", previously recited.) further in view of Freifeld (USPGN 2002/0191836). 

As per claim 105, 
Comaniciu/ Freifeld disclose 

a computer including a receiver configured to receive, from a remote source via a 
communications network, image data including at least one given image to be analyzed 
by one or more given vision tools that have been selected, and corresponding vision tool 
parameters corresponding to the selected one or more given vision tools that have been 
selected to analyze the given image(See Fig. 1, top block shows a vision tool parameters 
input, page 215, section 3, 2 nd para., "The client I/O module... .A fusion agent capable of 
multimodal inputs..." the I/O module takes vision tool parameters and send it to "Server 
Retrieval" at the bottom of Fig. 1, to perform "Feature Matching" ); 

the computer being configured to, following receiving certain data by the receiver, cause 
a machine vision engine to analyze, with the selected one or more given vision tools, the 
given image to be analyzed in accordance with the corresponding vision tool parameters 
received by the receiver; and 

wherein the machine vision engine includes the set of individually selectable vision tools 
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having been configured to, when selected, carry out vision operations including pattern 
location(page 214, left, 3 rd para., "...display the images from the database that are the closest 
matches to the query..." In order to find closest matches, patterns are located.) 

Comaniciu does not specifically disclose 

including selectable vision tools including the selected one or more given vision tools. 
However, Freifeld discloses 

including selectable vision tools including the selected one or more given vision 

tools(page 8, claim 31, "...said selected vision tool... results of all applied vision tools..."; 
[0018], "...He then set virtual vision tools..." where shows selections of visions tools.). 

Therefore, it would have been obvious to a person of ordinary skill in the art at the time the 
invention was made to incorporate the teachings of Freifeld into the teachings of Comaniciu to 
include the limitation disclosed by Comaniciu. The modification would be obvious to one of 
ordinary skill in the art to want to be able to perform multiple vision operations via multiple 
selectable vision tools. 

As per claim 118, it is a system claim essentially claiming the same limitations of claim 70 and is 
rejected for similar reasons for the rejection of claim 70. 
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As per claim 119, it is a method claim essentially claiming the same limitations of claim 105and 
is rejected for similar reasons for the rejection of claim 105. 

As per claim 120, it is a computer-readable media claim essentially claiming the same 
limitations of claim 105 and is rejected for similar reasons for the rejection of claim 105. 

As per claim 121, the rejection of claim 83 is incorporated; Comaniciu / Freifeld discloses 
wherein the vision tool parameters input is located in a manufacturing environment 

(Freifeld - [0005], "...manufacturing process..."). 

11. Claims 106-109 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Comaniciu et al. (herein Comaniciu, "Image-guided decision support system for pathology", 
Spring-Verlag 2000", previously recited.), Freifeld (USPGN 2002/0191836) further in view of 
Geodeon et al. (herein Geodeon, "Applying Machine Vision In Electrical Component 
Manufacturing"). 

As per claim 106-109, the rejection of claim 105 is incorporated; 
Comaniciu/Freifeld does not specifically disclose 

wherein the vision operations include guidance, inspection, gauging, and identification. 
However, 

Gedeon discloses 
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wherein the vision operations include guidance (page 748, left col. Middle, "vision guided 
robotic application...";), inspection, gauging, and identification (page 738, right col.) 
Therefore, it would have been obvious to a person of ordinary skill in the art at the time the 
invention was made to incorporate the teachings of Gedeon into the teachings of Comaniciu/ 
Freifeld to include the limitation disclosed by Gedeon. The modification would be obvious to 
one of ordinary skill in the art to want to examine the geometry of a product as suggested by 
Gedeon (page, 738, 4 th para, "...examine the geometry of the product..") 

12. Claims 1 10-1 17 are rejected under 35 U.S. C. 103(a) as being unpatentable over 
Comaniciu et al. (herein Comaniciu, "Image-guided decision support system for pathology", 
Spring-Verlag 2000", previously recited.), Freifeld (USPGN 2002/0191836), Geodeon et al. 
(herein Geodeon, "Applying Machine Vision In Electrical Component Manufacturing") 
and further in view of Edwards et al. (herein Edwards, "Machine vision and its 
integration with CIM systems in the electronics manufacturing industry"). 

As per claims 110-111, see reasons for rejections of claims 77-78. 

As per claim 112, the rejection of claim 105 is incorporated; Comaniciu discloses wherein the 
computer includes the machine vision engine (Fig. 1). 



As per claim 1 1 3, the rejection of claim 1 06 is incorporated; Comaniciu discloses wherein the 
communications network includes an internetwork(Fig. 1, shows a network). 



Application/Control Number: 09/842,948 
Art Unit: 2191 



Page 18 



As per claim 114, the rejection of claim 113 is incorporated; Comaniciu discloses wherein the 
internetwork includes the lnternet(Fig. 1, includes Internet). 

As per claim 115, the rejection of claim 105 is incorporated; Comaniciu / Freifeld / Gedeon 
discloses wherein the selected one or more given vision tools that have been selected 
have been selected at a location remote from the computer(Comaniciu - Fig. 1 client is 
remote from server). 

As per claim 116, the rejection of claim 105 is incorporated; Comaniciu / Freifeld / Gedeon / 
Edwards discloses further comprising a validator configured to verify associated validation 
data to ensure client account security, the associated validation data having been 
associated with the received given image, the selected one or more given vision tools, 
and the corresponding vision tool parameters (Edwards -page 15, left col. 3 rd para., "...to 
verify correct lead count and pitch..." ). 

As per claim 117, the rejection of claim 1 16 is incorporated; Comaniciu / Freifeld / 
Gedeon / Edwards discloses wherein the associated validation data has been 
received by the receiver (Fig. 1 the server receives data.). 



Response to Arguments 

In the remark, 

1) Applicant argues - 

Comaniciu is not a machine vision system. 

1) Examiner's response - 
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To the best of the examiner's understanding, a machine vision system performs the function of 
capturing image and processing the captured image for certain purposes. The Comnaiciu 
discloses such system as explained in the rejection of claim 70. Further, page 1 of Comaniciu, 
heading, clearly shows "Machine Vision and Application". For reason stated above, the 
examiner considers Comaniciu discloses a system in the field of Machine Vision System. 

2) Applicant argues - 

There is lack of motivation for combining Comaniciu and Frefeld. 
2) Examiner's response - 

Please refer to the rejection where motivation of combining Comaniciu and Frefeld is provided. 



Conclusion 

THIS ACTION IS MADE FINAL. See MPEP § 706.07(a). Applicant is reminded of the 
extension of time policy as set forth in 37 CFR 1 .136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within TWO 
MONTHS of the mailing date of this final action and the advisory action is not mailed until after 
the end of the THREE-MONTH shortened statutory period, then the shortened statutory period 
will expire on the date the advisory action is mailed, and any extension fee pursuant to 37 
CFR 1.136(a) will be calculated from the mailing date of the advisory action. In no event, 
however, will the statutory period for reply expire later than SIX MONTHS from the date of this 
final action. 
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The prior art made of record and not relied upon is considered pertinent to applicant's 
disclosure. 

It is noted that any citation [[s]] to specific, pages, columns, lines, or figures in the prior 
art references and any interpretation of the references should not be considered to be limiting in 
any way. A reference is relevant for all it contains and may be relied upon for all that it would 
have reasonably suggested to one having ordinary skill in the art. [[See, MPEP 2123]] 

Any inquiry concerning this communication or earlier communications from the examiner 
should be directed to Philip Wang whose telephone number is 571-272-5934. The examiner 
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